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ABSTRACT. This paper aims to introduce a large class of new general stabilization methods 
in optimization and saddle point theory. The concept of well-posedness in several senses 
is also investigated in metric and normed spaces. New variational asymptotic methods 
and some variational approximation results have been displayed within the framework of 


variational analysis and the theory of variational convergence of functions and operators. 


INTRODUCTION 


Approximation theory is a central subject in pure and applied mathematics. Notably it is 
encountered in algorithmic optimization when we use various numerical methods to approxi- 
mate a solution of class of extremum problems. In theoritical or parametric optimization, we 
very often study the sensitivity analysis of an initial minimization or maximization problem 
when the objective function and constraints are perturbed. Various types of perturbation 
schemes can be investigated, for instance if we consider an intial hard or ill-posed paramet- 
ric problem (Hg,) :min, ates f(x,@9), it is possible to replace it by a sequence of simple 
or well-posed problems (Hg) :minz.,(9) 8(x,0) such that ”(Họ) approximates (Hg,)”, that is 
the sequences of functions (g(.,@))g and sets (C(@))9 converge in a certain sense to f(.,00) 
and C(0o) respectively when 0 — o (for instance see [3,9, 34,72, 74, 75, 78] and references 
therein) , (0,05) EAXB, where A, B are abstract index sets and the convergence 0 — ĝo is 
considered in a specified sense using the notion of filters, nets or grills in general topological 
spaces [3,31]. Under a class of hypotheses, it is possible to show that the solutions x» of (Hə) 
have a cluster point x’ which is a solution of (Hg,) (see [3,9, 34,75] and references therein). 
If ((Ho)o are well-posed in a certain sense, it is possible to apply a large class of numerical 
methods to each problem (Hg) in order to derive a solution zg for it (see [34] and references 
therein).On the other hand the notion of well-posedness in optimization is strongly related to 

Key words and phrases. Asymptotic methods, generalized regularization methods in the Tikhonov sense, 


well-posed optimization problems, infimal-convolution, variational asymptotic developments, conjugacy, sta- 
bility and sensitivity analysis, epi-convergence, saddle functions, epi/hypo-convergence. 


©2018 Science Asia 


2 DRISS MENTAGUI 


the regularization methods considered as a logistic support for the theory of small parameter 
and asymptotic analysis. They play a crucial role in the stabilization and approximation of 
the solutions of a wide class of problems in pure and applied mathematics. Well-posedness 
has several definitions and characterizations in the literature [12, 13, 14, 34,112,113]. The 
concept of regularization or stabilization goes back to the works of Tikhonov (for instance, see 
[34, 100, 101, 102] and references therein) and has considerable applications as in variational 
analysis and optimization [3, 28, 68, 82,93], partial differential equations and optimal con- 
trol [30, 34, 50, 56, 63, 64, 65, 83], inverse problems |16, 21, 23,38, 45, 51, 110], plasticity theory 
[98], calculus of variations [34, 36,42], variational inequalities [2, 22, 43, 66,67, 75, 85], fixed 
point theory and inclusion problems [41, 60, 62, 87, 103], minimax and saddle-value problems 
(69, 86, 88, 94,95]. Besides the classical stabilization methods used in variational analysis 
and its related topics, other types of regularizations can be considered in functional analysis 
and operator theory [19, 20, 39, 45, 54, 88, 108], in statistics [37, 53, 55, 99] and serve as a very 
useful and flexible tool for establishing key results in these disciplines. 

The central feature of problems we regularize is their ill-posedness. This means that the 
solution fails to be unique or most importantly, small changes in data of the model, which 
are closely related to the errors of experimental measurements or unexpected phenomena, 
could lead to uncontrollable errors. In other words, the gap between the solutions (if any) 
of the perturbed model and the ones of the original problem may be very large relatively 
to a specified metric; accordingly meaningless interpretations may occur in the course of 
physical or economical investigations or other fields of experimental sciences. A natural 
idea is to replace the initial problem by a sequence of well-posed problems guaranteeing 
robustness and stability of their solutions and providing a large choice of numerical methods 
for approximating them. Roughly speaking, a model is said to be robust if its solutions and 
performance results remain relatively unchanged when exposed to perturbations, random 
phenomena and uncertainties. In Phillipe Vincke’s opinion [107], the uncertainty sources 
that have been considered as the most important are the following: 

i)The decision problem specifications are usually very imprecise, unpredictable, not much 
known and not well defined. 

ii) The environment in which the decision has to be taken could affect the conditions under 
which the decision could operate. 

iii) The unstable and imprecise character of the value systems and the decision-maker 
preferences has priority in deciding the feasibility and the relative interest of the potential 
alternatives. 

The terms robustness and stability are also very often used in many disciplines. For in- 
stance, in statistics they refer to certain desirable characteristics of statistical processes. A 
process is considered robust with respect to the deviations of the model hypothesis, when the 
process continues working in a suitable way, even though some of the initial assumptions are 
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not maintained [84]. In Hampel’s opinion [49]: Robust statistics is the statistics process sta- 
bility theory. It studies systematically the deviation effects from the initial model hypothesis 
to the known processes and, if necessary, it develops new and better processes. For more de- 
tails about robustness and its philosophy see for instance [15, 17,52, 57, 89, 92,97, 105, 106] . 

Before Hadamard’s theory on the stability in mathematical physics [29, 34, 47, 48, 59], most 
analysts payed special attention to stable models and consider the others as inefficient or 
enable to explain the results arising from experimental investigations in many areas of sci- 
ences. This way of thinking and analysing is one of the main characteristics of the scientific 
method prevailing during the 19th and the first half of 20th century, that of positive science 
based on the Cartesian method and characterized by the attempt of reducing the complexity 
to its elementary components. It turns out that this fabulous method which has brought great 
advances in sciences and adapted perfectly to the study of stable systems is no longer appro- 
priate when considering the organized complexity such as that found in complex biological 
systems, physics, economics and sociology ... etc; and characterized by openness, fluctuation, 
chaos, disorder, blur, creativity, contradiction, ambiguity, pradoxe and instability. All these 
aspects that were once perceived as nonscientific by the prevailing positivisme are henceforth 
considered as crucial prerequisites for understanding the complexity of real-world phenomena 
and have been taken in consideration since the previous seventy years in a new approach so- 
called systemic approach or mathematical modelling. As far as one is interested for instance 
by stable or unstable characters of systems which may have many senses from phenomenon 
to another, there exists actually a wide class of unstable problems covring a large field of ap- 
plications in many areas of sciences and technology [10, 34, 59, 101, 102] , and their rigourous 
mathematical analysis uses inescapably regularization methods adequately chosen for each 
specified problem. First let us consider some examples of stability and instability in physics 
and investigate by analogy the concept of stability in mathematical programming. Consider 
the known problem in classical mechanics that of physical pendulum which is a solid body 
of any shape form suspended from an horizontal axis at a support . Under the influence of 
gravity, the body will swing back and forth freely from an initial exitation 6). The position 
K(0) of the pendulum in the space can be described by the oscillation angles 6 of the body 
from its stable equilibrium position relatively to an appropriate vertical axis; and when 0 
goes to 0 the body reaches its unique stable position K(0). From a purely mathematical 
point of view, 6 € [—69, 90] =K(0) C R? describes a special multifunction K, and it is 
easy to see that the sets K(@) converge to the set K(0) in the sense of the classical Haus- 
dorff metric [3,34] when 0 goes to 0, that is dy(K(@), K(0))=max(e(K(@), K(0)), e(K(0), 
K(@))) — 0 if 0 — 0; where e(K(0), K(@))=supzex(o)d(v,K(0)). This expresses simply the 
continuity of K at 0 relatively to the distance dy . Now if we consider a multifunction 
of the kind ueC! [c,d] =T(u)= {a EC[a,b] / S? a(t) K(a, t)dt = u(x), Vx € |c,d]}, where 
K 


K:{c,d] x [a,b] > R is a continuous kernel with a continuous partial derivitive 2, it is well- 


known that such multifunction models a large class of inverse problems as in signal theory, 
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automatics, control problems (see for instance [101] and references therein). Assume that 
for some u€C! [c,d] T(u) is nonempty; we know [101] that T is unstable at u in the sense 
that there exist two sequences of functions (u,),, Un EC! [c,d] and (a,),, a, € C [a,b] such 
that a, €T(u,) with di(up,u) — 0 if n— +00 but do(an,,a) » 0 if k- +00, for any sub- 
sequence (ng), and any a €T(u), where dı, dz belong in a class of practical useful metrics. 
This explains simply a type of discontinuity of T frequently encountered in many problems 
and expresses that small changes u, in data u cannot lead in general to solutions a, of the 
integral equation ihe a,(t) K(x, t)dt = u(x), Vx € [c,d] Vn € N, which could be considered 
as good approximations of a in a desirable sense. 

The concepts of stability and instability can be also easily extended to optimization prob- 
lems. If we deal for instance with unstable minimization problems of the kind (P): minxecf(x) 
with nonempty solution sets denoted by argmin(f, C), (i.e. there exists a sequence (x,), in C 
without any cluster point such that f(x,) > minxecf(x)) where f: X— ]-o0,+00] is a proper 
convex lower semicontinuous function defined on a reflexive Banach space X renormed by 
an equivalent norm ||.|| making it an E-space [34] and C is a weakly convex compact; we 
can stabilize it by a sequence of strongly well-posed problems in the Tikhonov sense (P,,): 
minxec(f(x)+éng(x)) where g: X— [0,+00[ is any lower semicontinuous uniformly convex 
function; that is for each €, > 0, f+e,g has a unique minimizer x, on C and every minimiz- 
ing sequence of (P,,) converges srongly to x, [34]. Moreover, if en — 0, ||x,-%|| — 0, where z 
is a solution of (P) satisfying remarkable properties [34, 61] (see also [78, 79] if C is the whole 
space X and g is a specified function). Consequently, every numerical method generating 
a minimizing sequence for (P,) leads to an approximation of x, and so to 7 for a suitable 
choice of €,. In the last example, stability and instability characters may be interpreted in 
terms of special multifunctions as follows: If we set for each fixed € > 0 the multifunction: 
a € [0,+00[ = R*(a) = a. argmin(f + eg, C) = {x € C/f(x) + eg(x) < min(P.) + a} 
and R‘(0) = argmin(f + eg, C) = {x}, we see that R°(0) C R‘(a) and R‘ is stable at 
0 , that is, V ya € Ra), (Ya)a converges to x, if a — 0. Now, if we consider the multi- 
function € € [0,+oo[ = D(e) = e.argmin(f, C) and D(0)= argmin(f, C), we observe that 
D is unstable at 0 because there exists a minimizing sequence (Ze)e , Ze € D(e) without 
any subsequence converging to a point in D(0); in other words, (P) is not well-posed in 
the generalized sense of Tikhonov [34]. Other types of well-posedness can be found in the 
literature as Levitin-Polyak well- posedness, Hadamard well-posedness,...etce [14, 34, 73, 74]. 
It is worth noting that the class of well-posed minimization problems enjoys many interest- 
ing generic properties expressing in general that most problems are well-posed or may be 
approximated in a certain sense by a sequence of well-posed problems involving specified 
regularization functions [13, 34,91]. Also, it should be pointed out that the regularization 
methods with their diversity and rich properties provide flexible tools for characterizing 
classes of variational convergences for functions and operators [3,11,81] in approximation 
theory and optimization. Finally, in the author’s opinion, the regularization methods used 


NEW ASYMPTOTIC METHODS IN OPTIMIZATION AND APPLICATIONS 5 


in mathematics for theoretical or numerical goals have a physical analogy with the methods 
of correction and stabilization under the effects of turbulence and unpredictable phenomena 
in advanced technology systems in order to make them more robust face to the conditions 
of random nature, as in aerospace technology and ballistics [18, 27,35], in the theory of 
machine regulation [1, 32, 40, 46,90], or in the current problem of making more effective the 
missile-antimissile shield in military defense [111 |. 

The layout of this paper is as follows: Section 1 is devoted to a new characterization of 
well-posedness in metric and normed spaces. A new characterization via infimal-convolution 
operations is also given. In section 2 we introduce a new generalized stabilization method 
in a general topological space and prove a central theorem (Th 2.2) for a large class of 
minimization problems under suitable hypotheses. Afterwards, we observe through special 
cases of regularization functions that our assumptions are not restrictive and include most 
classical regularizations and more. Section 3 is devoted to the study of the stability of 
variational asymptotic developments by epi-convergence. Indeed, if the initial minimization 
problem is not easy to deal with and can be approximated in a variational sense by a 
sequence of simple problems (P,),, we apply the regularization technique in theorem 2.2 
to each (Pa) and derive variational asymptotic developments for the last problem; so by 
a diagonalization lemma established in [3], we prove uniform asymptotic developments for 
a subsequence (P,,). and deduce the stability of the minimum of sum of functions under 
consideration without having necessarily the stability of this sum by epi-convergence, even in 
the nonconvex case. For the stability concept of sum of functions ( and sets ) by variational 
convergences and its crucial role in variational analysis and optimization we refer the reader 
to [4, 9, 12, 70, 72, 74, 75, 77, 78, 80]. In section 4, we investigate the convex case in reflexive 
Banach spaces and give applications to asymptotic developments for the Legendre-Fenchel 
transform. In section 5 we introduce new generalized regularizations of saddle functions 
and state a fondamental theorem (Th.5.1) in which we provide some approximation results 
and variational asymptotic developments for the regularizations of bivariate functions in 
a Hausdorff topological space. An application is also given to the conjugacy of bivariate 
functions. Well-posedness of such new regularizations is investigated in section 6. In section 
7 we study the stability of variational asymptotic developments of the regularizations of 
saddle functions by epi/hypo-convergence. 


1. NEW CHARACTERIZATION OF WELL-POSEDNESS IN METRIC AND 
NORMED SPACES 


In this section, we will characterize some notions of generalized well- posedness in metric 
spaces. Let (X,d) be a metric space, C be a nonempty subset of X and f:X— [—oo, +00] is 
a function. We say that the minimization problem (f,C): minkecf(x) is well-posed on in the 
sense of Levitin-Polyak, if it has a unique minimizer x’€C such that f(x’) is finite and every 
sequence (Xn), of X verifying d(xn,C)— 0 and f(x,)-f(x’) converges to x’. (f,C) is called 
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well-posed in the Tikhonov sense if it has a unique minimizer t’€C such that f(t’) is finite 
and every sequence (x, of C such that f(x,)—f(t’) converges to t’. For the interest of these 
two notions in theoritical and algorithmic optimization see for instance [34] and references 
therein. We say that (f,C) is strongly well-posed if it has a unique minimizer z’€C such 
that f(z’) is finite and every sequence (Zp), of X satisfying d(z,,C)— 0 and limf(z,)<f(z’) 
converges to z’ [12, 14, 75]. In fact (f,C) may have many minimizers, so we need a generalized 
definition of well-posedness. Then (f,C) is called well-posed in the Tikhonov generalized 
sense [34] if the set of solutions denoted by argmin(f,C) is nonempty and every minimizing 
sequence (Xn)n Of C has a subsequence converging to an element of argmin(f,C). We say that 
(f,C) is well-posed in the generalized sense of Levitin-Polyak (resp.well-posed in the strong 
generalized sense) (see [12, 14, 34, 75] and references therein), if argmin(f,C) is nonempty and 
every sequence (Xn)n Of X verifying d(x,,C)— 0 and f(x,)—mincf (resp. if argmin(f,C) is 
nonempty and every sequence (Zn)n of X satisfying d(z,,C)— 0 and limf(z,)<mincf ) has 
a subsequence converging to an element of argmin(f,C). In what follows, we consider some 
notations we use here: C, = {xeX: d(x,C)< €}, u(f,C) =inf{f(x):xeC} assumed to be finite, 
e.argmin(f,C)={xeC:f(x)< v(f,C) + e}, Le) = {xeX:d(x,C)< €, f(x)< v(f,C)+e},D’(e) = 
{xeX:d(x,C)< €, |f(x)-v(f,C)| < €}.The Hausdorff distance between two nonempty subsets 
A,B of X is denoted by dy(A,B)=max (e(A,B), e(B,A)) where e(A,B)=supxead(x,B). 

DEFINITION 1.1. [34]. A function c:D- [0,+00| ,DC R is called a forcing function if 
0€ED, c(0)=0 and a, ED, c(a,) > 0 => a, > 0. 

DEFINITION 1.2. [34] .Let A be a bounded subset of X, the noncompctness degree of 


A, is the Kuratowski number of A, defined by a(A) = inf{e > 0: 3 (A;)i=1,2...n AC Ja; 

















and diamA; < e}.We can verify easly that a(A) < a(B) if ACB, and a(A) = 0 if sa only 
if A is relatively compact. 

PROPOSITION 1.3.Let (X,d) be a metric space, C be a nonempty closed subset of 
X and f:X— [—oo, +00] is a function such that u(f,C) is finite. Then (f,C) is well-posed in 
the generalized sense of Levitin-Polyak (resp. well-posed in the strong generalized sense) if 
and only if argmin(f,C) is compact and the multifunction € =L/(€) (resp.e =L(e)) is upper 
semicontinuous at 0. 

Proof. If (f,C) is well-posed in the generalized sense of Levitin-Polyak, it is clear that 
argmin(f,C) is compact. Now if e =L’(e) fails to be upper semicontinous (usc) at 0, there 
exist an open subset @ of X containing L’(0), a sequence (t,), of positive numbers converging 
to 0 and a sequence (Xn)n, Xn EL’(t,) with x, € 0.But , d(x,,C)— 0 and f(x,)— v(f,C), 
SO (Xn)n has a subsequence converging to an element of L’(0)= argmin(f,C); this is a con- 
tradiction because x, € 0.Conservely, let (xn), be a sequence of X such that d(x,,C)— 0, 
f(xn)— v(f,C) and pick € > 0.The usc at 0 implies that x, € (L/(0)). for all n sufficiently 
large, so d(x,,argmin(f,C))— 0 and by compactness of argmin(f,C), (x,), has a subsequence 
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converging to an element of argmin(f,C). In the same way we show the second equivalence 
replacing L’(e) by L(e). 

PROPOSITION 1.4. Let (X,d) be a metric space locally compact, C be a nonempty 
closed subset of X and f:X— |—oo, +00] is a proper semicontinuous function. Suppose that 
for every € > 0,L(e€) is connexe. The following assertions are equivalent: 

(i) L(e) is compact for some € = € > 0. 

(ii) (f,C) is well-posed in the strong generalized sense. 

(iii) argmin(f,C) is an nonempty compact. 

Proof. First we point out that (f,C) is well-posed in the strong generalized sense if 
and only if (g, X) is well-posed in the Tikhonov generalized sense with g(x)=max(f(x)- 
u(f,C),d(x,C)). 

Afterwards, we apply proposition 1.4.2 of [75, p.23] (and references therein) and some 
arguments of its proof to obtain the previous equivalences. 

THEOREM 1.5.Let (X,d) be a metric complete space, C be a nonempty closed subset 
of X and f:X—> R is a continuous function. Then (f,C) is well-posed in the generalized sense 
of Levitin-Polyak if and only if a(L’(e)) — 0 if € — 0. 

Proof. If (f,C) is well-posed in the generalized sense of Levitin-Polyak, we claim that 














L’(€9) is bounded for some positive €o; If this is not the case, L’(e) is unbounded for every 
positive €,so there exists a sequence x, €L’(+) such that d(x,,xo) >n, where xo is a fixed 
point in X; this is a contradiction because (x,), has a converging subsequence; accordingly 
L’(e) is bounded for every small positive € and a(L’(e)) exists. We remark also that (f,C) is 
well-posed in the generalized sense of Levitin-Polyak if and only if (G,X) is well-posed in the 
generalized sense of Tikhonov where G(x)=|f(x)-inf,f|+d(x,K), xeX. Then the conclusion 
of the theorem is an immediate consequence of [34, Th.38, p.25] and the trivial inclusion 
L’(5) C e.argmin(G,X) CL’(e). 

THEOREM 1.6.Let (X,d) be a metric complete space, C be a nonempty closed subset 
of X and f:X— R is a lower semicontinuous function. Then (f,C) is well-posed in the strong 














generalized sense if and only if a(L(e)) — 0 if € — 0. 

Proof. It is clear that (f,C) is well-posed in the strong generalized sense if and only 
if (g,X) is well-posed in the generalized sense of Tikhonov. On the other hand g is lower 
semicontinuous and X is complete, then [34,Th.38, p.25] permits to conclude, because for 
all €, we have ¢.argmin (g,X)=L(e). 

THEOREM. 1.7. Let (X,d) be a complete metric space, C be a nonempty closed bounded 
subset of X and f:X— ]—oo, +00] is a function. 

1) If f is finite and continous,Then (f,C) is well-posed in the generalized sense of Levitin- 
Polyak if and only if there exits a forcing function c such that for every bounded subset A 
of X satifying supxea |f(x)| < +00 one has : 

(1.1) c(a(A)) <max(supxea |f(x)-u(f,C)] ,supxead(x,C)) 
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2) If f is lower semicontinuous, then (f,C) is well-posed in the strong generalized sense if 
and only if there exists a forcing function c verifying for every bounded subset A of X such 
that supxeaf(x) < +00: 

(1.2) c(a(A)) <max(supxeaf(x)-u(f,C) ,supyead(x,C)) 

In particular (f,C) is well-posed in the strong generalized sense if there exits a forcing 
function c such that: 

(1.3) c(a(A)) <supxea (f(x)-v(£,C)) 

for every bounded subset A of X such that ANC 4 Ø and supxeaf(x) < +00. 

Proof. 1). We will be inspired by the proof of theorem 39 of [34, p.26] .Assume that (f,C) is 
well-posed in the generalized sense of Levitin-Polyak, then a(L’(e)) — 0 if € — 0 by theorem 
1.5.Set q(e) = a(L’(e)) and c(t)=inf{s:q(s)> t}. By [34, Lemma 20] ,c is an increasing forcing 
function satisfying c(q(e)) < € for every € > 0. Let A be a bounded subset of X such 
supxea |f(x)| < +oo and consider p=max(supxea |f(x)-vu(f,C)| ,supxead(x,C)), we have p> 0 
and ACL’(p), so c(a(A))<c(a(L’(p))=c(q(p))<p and then (1.1) is satisfied. Conservely if 
(1.1) holds for every bounded subset A of X such that supxea |f(x)| < +09; set in particular 
A=L’(e) which is clearly bounded so c(a(L’(e)) < € , accordingly a(L’(e)) — 0 if € > 
0.Theorem 1.5 permits then to conclude. 

2).This equivalence can be shown in the same way as point 1) using theorem 1.6. Now 
suppose that (1.3) is satisfied for every bounded set such that ANC # Ø and supxeaf(x) 
< +00. We will show that (1.2) is satisfied. Let B be a bounded set with supxegf(x) < +00. 
We may always assume that c is an increasing function. If BOC #4 ©, we have always 
c(a(B)) <supxer(f(x)-u(f,C))<max(supxep |f(x)-u(f,C)] ,supxepd(x,C)) and (1.2) is satisfied. 
If BNC = @,we consider two cases: if there exists (a,b)€CxB such that f(a)<f(b), then set 
B’=BU{a}; we have c(a(B)) <c(a(B’)) <supxsepf(x)-u(f,C)=supxepf(x)-v(f,C) and (1.2) is 
satisfied. If for every (a,b)€CxB f(b)~f(a), set B(a)==BU{a} for every a€C such that f(a) 
is finite, then by (1.3) we have c(a(B)) <c(a(B(a))) < 

SUPxeB(a)f(x)-u(f,C)=f(a)-v(£,C), so c(a(B)) = 0 and again (1.2) is satisfied which com- 
pletes the proof. 

THEOREM.1.8.Let (X,d) be a metric space, C be a nonempty subset of X and f:X— R is 
a function. Assume that there exists a forcing function a:R — R* continuous at 0, a(0) = 0 












































such that a(f-u(f,C)) is uniformly continuous. If (f,C) is well-posed in the generalized 
sense of Levitin-Polyak then we have the following implication (P): for every sequence of 











functions f,:X— R converging uniformly to f on X and for every sequences (Cy)n,(Xn)n of 
subsets of X such that dy(C,,C) — 0, dy(X,,X) — 0 and x, €argmin(f,+d(.,K,,), Xn) 
then d(x,,argmin(f,C))— 0 when n— +oo.Conservely if the last implication is true and 





argmin(f,C) is compact then (f,C) is well-posed in the generalized sense of Levitin-Polyak. 
Proof. If (f,C) is well-posed in the generalized sense of Levitin-Polyak, it is easy to see 

that (G,X) is well-posed in the generalized sense of Tikhonov and argmin(f,C)=argmin(G,X) 

with G(x)=a/(f(x)-u(f,C))+d(x,C).By hypothesis G(x) is uniformly continuous, so (G,X) is 
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well-posed in the generalized sense of Hadamard (see|75, p.26] and references therein) and (P) 
is satisfied. Conservely if (P) is satisfied, let be a sequence (Xn), of X verifying d(x,,C)— 0 
and f(x,)—mincf. Set f,(x)=|a(f(x)-min,f)-a(f(x,, )-min,f)|, C,=CU{x,} and X,=X. It is 
clear that (f,), converges uniformly to a(f(x)-mincf) on X, dy(C,,C) > 0, du(Xh,X) =0 
and x, €argmin(f,+d(.,C,), X); so d(x,,argmin(f,C))— 0 when n— +00 which completes 











the proof. 





In what follows X will be a normed space with its norml|.|| and d(x,y)= ||x-y|| is its 
associated metric.Considering two functions f:K— ]—oo, +00] , g:K’— |—00, +00] where K,K’ 
are two subsets of X. the fonction denoted by fVg called the infimal-convolution (or epi- 
sum) of f and g is defined on K+K’ by (fVg)(z)=inf{f(x)+g(y)/ (x,y)€KxK’ and z=x+y}. If 
K=k’=X, we can also write (fVg)(z)=infex{f(x)+g(z-x)}. This notion of convolution plays 
a crucial role in optimization and variational analysis (see for instance [58, 75,76, 78] and 
references therein). We say that fVg is exact at a point ze K+K’if there exists (x,y)EK xk’ 
such that z=x+y and (fVg)(z)= f(x)+f(y). 

THEOREM. 1.9. The following assertions are equivalent: 

(i) (f,K) anf (g,K) are well-posed in the Tikhonov sense with xo,yo their unique solutions 
respectively. 

(ii) (Ve, K+K’) is well-posed in the Tikhonov sense with solution z) =xo+yo and fVg is 
exact at Zo. 

Proof. (i)=— (ii). For every xeK, y€K’ one has f(xo) <f(x) and g(yo)<g(y), so 
( fVg)(xotyo ) <f(xo)+g(yo)<( fVg)(z) Vz EK+K’; 
accordingly Zo =xo+yo Cargmin(fVg,K+K’) and ( fVg)(zo)=f(xo)+g(yo) i.e [Vg is exact 
at Zo. Now let (z,), be a sequence of K+K’ such that ( fVg)(z,) —( fVg)(zo),then there 
exists a sequence (Un,V,) €KxK’ such that zn =u,+v, and f(u,)+f(vn)-f(x0)+g(yo) so 
f(un)>f(xo) and f(vn)>f(yo) and (un,Vn) > (Xo0,Yo ) € Zn Zo. 

(ii)=>(i). The exactness of [Vg at z =xo+yo implies that (fVg)(zo)=f(xo)+2(yo) 

<( fVg)(z) for every zEK+K’, so f(xo)+2(yo)<f(x)+g(y) Y(x,y)EKx K’ and xp Eargmin(f,K), 
yo €argmin(g,K’). Now considering a sequence (x,), in K such that f(x,) -f(xo). For every 
n, we have f(xo)+g(yo)< (Vg) (xn+yo)<f(xn)+g(yo) so (£V2)(n+¥0)> (fVg)(z0) and by 
hypothesis x,,+Vo —Xo+yo 1.€ Xn Xo and (f,K) well-posed in the Tikhonov sense with xo its 
solution. In the same way (g,K) is well-posed in the Tikhonov sense with y, its solution. 


2. NEW GENERALIZED REGULARIZATIONS IN THE TIKHONOV 
SENSE 


The goal of this section is to introduce a new generalized regularization method in the 
Tikhonov sense in a general topological space and generalize a result established in reflex- 
ive spaces for convex functions [78,79] and concerns the classical Tikhonov regularization 
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method used in variational analysis and its related topics. More precisely, considering a re- 
flexive space X renormed by a strictly convex norm ||.|| making it an E-space [3, 33, 34, 104]. 














Let F:X— RU {+00} be a proper convex lower semicontinuous function and set for each 
€ > 0, F.(x)=F(x)-+e ||x-xo||’where xo is any given point in X. Assume that S=argmin(F, 
X)={x €X/ F(K)=minsexF(x)} is nonempty, then we have the following result: 


THEOREM 2.1 [78,79]. (a) Fe has a unique minimizer x. over X for each €; (b) the 
sequence (x.). converges strongly to to = projs Xo when € — 0; accordingly PG.) Flt) — 0, 
F<(x,)-F (to) —€llxo—to |? 


Throughout, unless otherwise stated, X stands for a general Hausdorff topological space, 


+0, if € > 0. 























f:X— RU {+co}, g: X— R be two lower semicontinuous (Isc) functions with f is proper and 








C be a nonempty closed subset of X. Along the paper we are concerned by the minimization 
problem (P): minxec f(x). We will denote by S= Argmin(f ,C) the solution set of (P) assumed 
to be nonempty and by domf={x€X/ f(x)<+oo} the effective domain of f such that domf f) 
C Æ 0. Now consider a sequence h4:X— R of functions such that rx =infkechx(x) is finite for 














all k>kp. To (P) we associate the following generalized regularization problem (P,): minxec 
F(x) where F,(x)= f(x)+ag(x)+hx(x), & > 0 and we suppose that ey — 0 if k— +00. 
THEOREM 2.2. Assume that the following conditions hold: 
(a) i, =infc F4 is finite for every k>kp and (zz), be a sequence of C relatively compact 





satisfying: 
(2.1) uk 0, k +00 
(b) (2.2) “Te + 0, k— +00 , V sES 
Then: 


(1) any cluster point Z EC of (zx), verifies Z Eargmin(g , S). 

(2) f(z) -f£(Z) and g(z,) >g(Z) when k> +00. 

(3) there exist sequences (ô4)z,(0,)x,(0x)x,(0%)x of scalars converging to 0 such that we have 
the following asymptotic developments F(z.) = minsec f(x)+exminses g(x)+ inf xec hx(x) + 
Or =minsec f(x)+e,minzes g(x)+inf xes hy(x) + 60,; and info F, =min,ec f(x)+exminses 
g(x)+ inf xec hy(x) + Ekby =minsec f(x)+eEminzeg g(x)+inf xes hx(x) + EO. 

REMARK 2.3. In theorem 2.2, g is not necessarily positive as it is always supposed 
in the literature. On the other hand, it is clear that we can find always a sequence (zz) x 


Tati = 0, but in general 


in C such that Fi(z)< i, + € if i, is finite, so limp +400 
(Zz), is not relatively compact . If (P;,) has a solution x; for each k>kp and we take z;=x}4 
then (a) is straightforward satisfied if (x;,), is relatively compact, so from (3) there exists a 
sequence (ax)x of numbers converging to 0 such that Fy(x,)=minzec(f(x)+exg(x)+hx(x))= 
min,ccf(x)+e,minges g(x)+infsec hy (x) + ax. The proof we display here is very different 
from the one used in [78,79]. 

Proof. Pick e > 0. By (2.1) we have for k large enough, Fy(z,)=f(z,)+exg(ze) + 


hx(zx) <info Fr + exe <f(s)+exg(s)+hx(s)+ exe Y SES. Then, 





NEW ASYMPTOTIC METHODS IN OPTIMIZATION AND APPLICATIONS 11 


(2:3) O<f(z;,)-f(s)< a(g(s)-g(zx))+hx(s)-rx + exe , V SES 
Hence we deduce that 
(2.4) 8(2x)<g(s)+ 2 +e,Vses 
and lim,g(z)< lim,g(z,)<g(s)+e by (2.2) for every € > 0 and sES. So, 
(2.5) limgg(za) < Tima (zx) <e(s), Y seS 
Now by lower semicontinuity of g and relative compactness of (z,), we can find me R 
such that m<g(z;,) V k. We derive from (2.5) that (g(z,)), is bounded and f{(z,)—min,-c 
f(x) by (2.2) and (2.3); so by lower semicontinuity of f we get f(Z) =min,<cf(x) for any 














cluster point Z EC of (zp), i.e Z ES. Since g is lower semicontinuous, (2.4) and (2.2) imply 
that Z Eargmin(g, S). Again by lower semicontinuity of g, boundedness of (g(z,)), and 
(2.5) we may check easily that (g(z;))4 has the unique cluster point g(Z) —min.-sg(s) to 
which the sequence converges. This ends the proof of (1) and (2). Now take s= Z in (2.3); 
we have 0< Megan £ <g(2)-g (zx) +2 +e, hence a, = es ro £ — 0 when k> 
+oo. Keeping in mind that hy(z,)<hy(Z)+ex(g(Z)-g(Zr))+exe, we derive that 0< (en) Te < 
Mj rk J “k +-9(Z)-g(z,)+e and then lent — 0 when k> +00 by (2.2) and (2). On the other 
a Fzr)=f(r)=Te — g(zr)+hx(zr)=Te — g(z)+ Pire, Set J, = Fr) fer) TR —g(?). 


Ek Ek Ek Ek 
It is clear that V, and 6, = Vk ta, = AeA _ 9 (2) converge to 0 if k— +œ and 
Fi (ze) = F(Z) + eg) + rx + 0x =minsec f(x) +exminses g(x)+infreo hy(x) + €xd,. From 
(b) it is easy to see that infses hls) re = dy — 0, k> +00 , so rx = infseg h(s) — ekdk 


and F(z) =mingecf(x)+ éminses g(x)+ infs hk +10, with 0, = 6, — dp. The asymptotic 








development in infcF, is an immediate consequence of the last developments and (2.1) which 














completes the proof of (3). 

REMARK 2.4. Hypothesis (b) in the above theorem is not restrictive. Indeed, consider 
the wide class of functions h, given by h4(x)=5 7; 8,,gi(x) where g: X— R is any function 
bounded below by a scalar m; on C, 54; > 0 for every ke D 1< i <p and on — 0 when k— 
+oo, Vi. It is easy to see that ry > 377, Brim; and 0 < RO ay Pail i(x)-m;) which 


i=l ek 

















goes to 0 when k— + for every x€C, so (b) is satisfied. "The regularization functions be- 
come F),(x)= f(x) +eg(x) +577 kigi). In particular one may consider the functions of the 
kind hy (a) = ef{h(x), q> 1 with h:X—> R is any function such that infch>-oo. If X is a normed 
space we can use also the regularization functions F,(x)= f(x)+ex ||x-x1 |” +X € ||x-x; 

















where x; is any given point in X and p; € N. More generally, if we take in a general 
topological space h4(x)=5 f_i bki Ski(x) with gri X—> R , Aki > 0, Pri — 0 if k> +00, 
V i=1,2...p and we assume that there exist scalars m4; such that mz; <gri(x), V xeC 


with limk+o 724 Pri (gk:(X)-Mx:) = 0 for every x in C, then (b) is satisfied. In partic- 




















ular, one may consider the useful regularization functions h4(x)=3 7. qi(eg Jeter) Ae bd 4% 
where w,(ex) > 0, qi(ex) 2 0 , y; € R for every i=1,...p and ke N with ail) > 0 if k > œ, 
b; € R and A;:X— R is any lower semicontinuous operator. In this case the constraint set 
is defined by C={x€X/A;x-b; < 0, Vi} assumed to be nonempty. For the case q;(€,) = &, 
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pilek) = 3°, y; = 0 and its importance in optimization, see for instance [28] where the 


ep (Aiz—bi) for solving the 


authors study the special regularizations F;,(x)=(c,x) + #5 _e 
linear program min{(c,x): A;x-b; < 0, i=1...p} in finite dimentional setting with A; is a 
linear operator. This kind of regularizations combines the interesting properties of the inte- 
rior barrier method and of the exterior penalty method. It should be pointed out that we 
can’t always ensure higher order asymptotic developments in theorem 2.2 even under strong 


regular conditions on functions under consideration. For example consider the sequence 











of regularization functions F.(x)=x* + ex+e?x?, xeC= R reaching their minimizers at the 





points x, = 5£(1+*)~'. If we write F.(x)=== (1 + e°)! =ming x? + eming—so} x+e?ming 
x? + eple) then qe) = (1 +) 1 — —ż if e — 0. Now take another example: Let 
F.(x)=f(x)+ex? + €x’, 0< € < 1 with f(x)= x-1 if x> 1, f(x)=0 if xe [-1,1] and f(x)= 
+oo otherwise. Then S=argminf=[—1,1] and the minimizer of F4 is attained at x, = 0. If 
F.(x.)=0 = mins 1 f + eminses 2° + Pmingx?+ ey(e) then y(e) = 1. 

Now we state two corollaries expressing that under suitable hypotheses, a sequence (z,), in 














C satisfying (2.1) is relatively compact. First recall that a function j: X— R is inf-compact 
[58] if {xe X/j(x) < A} is compact for each À € R . If for a subset A of X {xe A/j(x) < A} 
is compact for each À € R , we say that j is inf-compact on A. If X is a metric space and 






































je : X > R, ke N, we denote by e-limj,(x) = infs(2,),/a,>c}lim jx(v,) the epi-limit inferior 
of the sequence (jx) [3]. 

COROLLARY 2.5. Let F; be the functions considered in Th.2.2. Let (Z) be a sequence 
in C such that: (ai) i, =infc F4 is finite for every k>k, and limp 44. Dai = 0; (a) 
hypothesis (b) of Th.2.2 is satisfied; (az) {x€ C/g(x) < Ao}is compact for some scalar 
Ao >g(so) and some sp ES. Then (Zz), is relatively compact. 

Proof. From the proof of Th.2.2, we see that limxg(24) <g(s) for every seS. Let ào >g(so) 
for some so ES such that Ly, ={xe C/g(x) < Ao} is compact . We have lim,g(z,) < Ao and 
Zp EL\, for every k sufficiently large, so (z%)x % is relatively compact and the conclusions of 
Th:2.2 hold. 

COROLLARY 2.6. Let F, be the functions considered in Th.2.2 such that hypothesis 
(a,) of Corollary 2.5 is satisfied with lim,F,(z,) < +oo and g is bounded below on C by 
a scalar m. Consider the following hypotheses (Hı) and (H2) with (Hı) : There exists 











y € R such that ry > y, Vk > k and f is inf-compact on C; (H2) : X is a vector space 
of finite dimension, họ : X — R are lsc and VA € R 3 ky € N such that Vk> k, the set 
{x€ X/hx(x) < A} is connected (in particular this is true if hy, is convex) and the function 
































x€X— e-limh;(zx) is infcompact. If (H1) or (H2) is satisfied then (zx), x is relatively compact; 
accordingly if hypothesis (b) of Th.2.2 is satisfied then the conclusions of Th.2.2 hold. 
Proof. First we observe that there exist two scalars 0, 5 such that for all k sufficiently 
large F,(24) < 6 and F;(x)> f(x) +6+h;,(x) VxEC, so Fy (x)> f(x) +6+7 if (Hi) is verified, 
and then z% € {x E€ C/f(x) < 6 — 6 — y} which is compact. On the other hand, it is clear 
that there exists a number a such that F;(x)> a+h4(x) for every x€C and every k large 
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enough. Now if (H2) is satisfied, by [109] the functions h, are uniformly inf- compact, in 
particular there exist a compact K and k’€ N such that Vk > k’, {x € X/hi (x) < 6—a} CK, 
so Z EK. The reminder follows wich completes the proof. 

REMARK 2.7. Hypothesis (Hə) in Corollary 2.6 is in particular satisfied if X is a 
vector space of finite dimension and (h;), is a sequence of convex functions from X into R 























epi-converging to a proper inf-compact function h:X— RU {+co} [109]. 
COROLLARY 2.8. Let f:C—> RU {+2}, g: Co R, i=1,2...p, be lower semi- 


continuous functions and assume that f is finite at a point of a compact C of X.Then, 
mingeo(f(x)+eg1 (x END 2 Giegi(t))— minyec f(x) 





























lim,_,o+ 





=minzesgi(x) for every sequences ( dic), i=2, 

..p such that a; > 0 and Time jot % ae =0. 

Proof. The proof is an edit consequence of theorem 2.2, remark 2.4 and the fact 
that lim, ,o+ Mec bee) sine eos) 

2.9. General Asymptotic Developments with Particular Regularizations 

It is useful to provide general asymptotic developments with particular regularizations. In 
the sequel we are concerned by the regularizations of the kind F,(x)= f(x) +eg(x) +577 6:8 () 
as it is mentioned above with Øk; > 0, frs 





— 0 for every i when k— +oo . We as- 











sume furthermore that all functions g;: X— R are lsc with fe — 0 when k> +œ , 





Vi and C is compact.Then S; =argmin(g; ,C) is nonempty and g;(x) > m; V xeC for a 
scalar m;. Our goal is to compute mingF,. In each following computation, assume that we 
are within the framework of hypotheses of theorem 2.2 with functions under consideration. 
We have minc(f+ekgt bp 1 81)= ming f +emins g+ p ,ming git «ar; minc(f+es+B: 
gı + Po S2)=ming f +emins g+ bpıminc (gı + F289) + Eak 2 =minc f +emins g+ 


. B . B 
By, (ming gı +7 mins, g2 Pace 7 ik 2) +exar2 =minc f+exming g+ Bp minc git+; ming, g2+ 


By 20k2+€kk,2- By the same argument we have ming (f+ekg8t bp 1 81+ bk 282+ bk 383) =minc 
f+e,ming g+ Êr minc 81 + 6, ming, 82+/Bx3minc 83 + Bro0k,3 +ekak 3 and minc(f+exg Pra 
81 + Pr,282 + By 383+ By 484) =ming f +emins g+ bp minc gi + bp 2Ming, g2 + By 3ming g3+ 
Bka Mins ga + Bp 20k, 4t Brg On + €,@%,4. Then the obvious generalization is minc(f+exg+/8} 1 
Sit Pie 82+- +bkp &p)=ming f +e,ming g+ By minc gi +f, ming, g2+...+ 6, pins, 8p t 
di, + €kVk,p if p is even and minc(f+exg+By1 81+ Bo 82+- + Bp» Sp)=minc f +exmins g+ 


P oP 
dk €k 


Ek? € 



































Braminc gı + Bko mMins g2 +. + Bk pminc gp + el + EkWk p if p is odd with Vk p ;Wk.p : 
converge to 0 when k— +00. 
3. STABILITY OF VARIATIONAL ASYMPTOTIC DEVELOPMENTS BY 
SEQUENTIAL EPI-CONVERGENCE 


In this short subsection we investigate the stability of asymptotic developments under 
epi-convergence, that is a variational convergence [3] which preserves the stability of the 
minimum of functions if a relative compactness hypothesis is satisfied. In order to state our 


result, we recall the definition of epi-convergence and its importance in variational analysis. 











Let fn,f :X— R be a sequence of functions. We say that (f,), epi-converges sequentially to f 
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on X and we write f, epi — seq f if: (1) Vx, Vx, >x, f(x)< lim, f,(x,); (2)Vx, 3x, x such 
that f,(x,) —f(x). Convergence in this sense has remarkable properties in the literature. 
One of the crucial properties in a general topological setting is the following stability result: 

THEOREM 3.1 [3]. Assume that f, epi — seq f and consider a sequence (x,), in X such 
that f,(x,) <infxf, + Yn Yn — 0 with +, > 0 and infxf, € R. Then for every converging 














subsequence (Xp, ) 
k— +00. 
Now return to problem (P) with C=X and assume that the Isc proper functions f,:X— RU 


, to an element 7, we have T € argmin(f, X) and fn, (£n) —minxf when 























{+co} epi-converge sequentially to £X— RU {+00} and there exists a sequence (x,), in 





X having a subsequence x,, = y, — t and minxf, =f,(¢,) Vn. Denote by FR(x)= 











fa(x)+ekgn(x)+hg(x) the regularization functions associated to f, with g,:X— R is Isc and 

















suppose that hą epi — seq h with h:X— RU {+co} is proper. Assume also that there 
exists a sequence (z7),., relatively compact such that for every k, n, ig =infyF? is finite, 
ie — 0, Here — 0 when k— +00, V sE€S„ =argmin(f,, X), V n. Following theorem 
2.2, there exists a sequence (07) of scalars converging to 0 for each fixed n when k— +00 
such that we have the following asymptotic development A? =F} (z}) =minxf,+ecmins, g&n + 
infxhg(x) + 0x. The stability result is stated as follows: 


THEOREM 3.2. There exists a subsequence (nj,), satisfying 

(Ape, Og, He’) 5 (min yftminyh = £(2)+h(#),0,0) if k-+ +oo where F Eargmin(f, 
X) (A argmin(h, X). In particular if z? =x? Eargmin(F? , X) we have min x (f +ek8, thk) > 
min x (f+h)=minxf+minxh when k— +00. 
hy (Yp)—Tk 

€k 
shows that there exits a subsequence (pp) (which can be computed) such that d?" — 0 if 


Proof. Because d? = — 0 when k— +00 Vp, the diagonalization lemma [3] 
k— +00, so for a given € > 0,hx(Yp,) < infxhx + exe for k large enough, and by theorem 
3.1 we conclude that infyh, —minxh and ¢ € argmin(f, X) N argmin(h, X). But for each 
fixed p, (A;”, óp, HG) — (minxf,,+minxh, 0,0) if k> +oo and minxf,, —minxf 
when p— +00; accordingly by the diagonalization lemma again, there exists a subsequence 
(np, —),)k satisfying (AFF, 6,7, BG) — (minxf+minxh ,0,0) if k— +oo. The remaider 
follows, which completes the proof. 

REMARK 3.3 It is worth pointing out that the stability result established here 
holds regardless of the epi-convergence or not of the sequence ( fy FEE, +h), to f+h! and 














without having any information on the behavior of the sequence (ex Je L 
4.THE CONVEX CASE 


In this section we apply the above results to convex functions defined on a normed space 
and derive asymptotic developments for the Legendre-Fenchel transform. 
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PROPOSITION 4.1. Let X be a reflexive Banach space and f: X— RU {+00}, g, 
hy, : X— R are convex proper lower semicontinuous functions. Let C be a nonempty closed 























convex set of X such that S=argmin(f, C) is nonempty. Assume that: 
(a) {xeC/ g(x)< A}is bounded VA € R; 
(b) SE _, 0 if k- +00, V seS. 


€k 














“ar, — 0 when k— +00. Then (zę) is weakly 


Let (zk)4 be a sequence of C such that 
relatively compact and the conclusion of theorem 2.2 holds. If argmin(g, S)={a} (particularly 
when g is strictly convex ) then (74), has a unique weakly cluster point Z=a@ and z, — @ 
where — denotes the weak convergence. Moreover if the conditions g(t) — g(t) and t — t 
imply that ||t, — t|| — 0, k— +00 one has ||z, — @|| — 0 when k— +00. 

Proof. First, we point out that Lk = {xeC/ Fy (x)< A}c {xeC/g(x)< Acmine Ih} for 


each k and À € R, so Lf is weakly compact and by a classical argument [58] , i, = ming Fẹ = 














Fi,(x,) for some x, EC. Now by reflexivity, convexity and Corollary 2.5, it is immediat that 








(zx)x is weakly relatively compact.The remainder follows by an obvious verification. 





In the theorem below, we give sufficient conditions ensuring that the minimization problem 











(F, C) is strongly well-posed in the Tikhonov sense. Given two functions p, q: X> RU 





{+00} and consider the following hypotheses: 
(Hp): Ay = {x€C/p(x)-A |||] < O}is bounded for every À € R. 
(H,): q(x) — q(x) and x, — x imply that ||£n — x|| — 0 when n> +00. 
THEOREM 4.2. Let X be a reflexive Banach space and suppose that 

F(x) =f(x)+exg(x)+h,(x) is strictly convex on a closed convex subset C of X. Assume 














that (H,) and (H,) hold simultaneously at least for two functions p, q (eventually identical) 




















belonging in the set {f,g,h;} where f: X— RU {+00}, g, hy : X— R are convex proper lower 








semicontinuous functions. Then (Fp, C) is well-posed in the Tikhonov sense. 

Proof. Let F(x) =f(x)+eag(x)+hx(x), & > 0. Each function f, g, hy has a continuous 
affine minorant, so if pe{f,g,h;} then there exist a > 0, 8 € R such that F(x) > —a|la|| + 
B+-yp(x) (y = ey if p=g and y=1 otherwise). It turns out that LE ={xe C/F,(x) < A}C 
{x€ C/p(x) — = \|a|| 4 £ < A} which is bounded by (H,) for every À € R; so LẸ is weakly 
compact and (F4, C) has a unique solution xg. Now let (x,), be a mimizing sequence for (Fx, 
C). Since Fy(x») —Fr(xx) € R when n— +00, (x,), belongs to a sublevel of Fẹ and (Xn)n 









































is bounded. By lower semicontinuity of Fẹ, every cluster point zE C of (x,), for the weak 
topology satisfies F,(2)=F4(x%,) So z=x4 and x, — Tp . Set an = f (En) +Ekg(En) + hx(tn) — 
f(k) — Exg(tx) — Ae (ae) — 0 if n> +00. We have f(x) — f(x) = an +Ex(g(xr) — G(Ln))+ 
hylur) — he (an) and lim, (f (an) — fxx)) < ex (g(xx) — lim, g(æn)) + xxx) — lim, he (tn) < 0; 
accordingly lim, f(x,) < f(xx) < lim, f(x,) and f(x,) > f(xx). By the same argument one 
has g(£n) — g(xx) and hk(£n) > hy (xp). From (H,) we conclude that |[x, — x,|| — 0 when 
n— +00. 
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Note that a reflexive Banach space may be always renormed by a strictly convex norm ||.|| 
such that (H,) is satisfied with q(x)=||.|| [104]; so one can take for instance in proposition 
4.1 or in theorem 4.2, g(x)=||a — xol|", r> 1 and x is any given point in X. In this case 
the sequence (x;)4, where x; is the minimizer of Fẹ on C, converges strongly to projsto in 
Proposition 4.1 (or in Theorem 4.2 if (b) is satisfied). Also we point out that, even though 
(H,)and (H,) fail to be satisfied with p, qe{f, g}which can be imposed by an algorithm, a 


large choice of the ” 


negligible” terms h, may guarantee the verification of (H;,,)and (H,, ). 
It is worth noting that the only role of hypothesis (H,) is to ensure the boundedness of 
L*. It can be replaced for instance by the following hypothesis: two functions of {f,g,h;, }are 
bounded below and the third is weakly inf-compact; for example f, g are bounded below and 
h; is weakly inf-compact. 
4.3. Application to Legendre-Fenchel Transform 
In the sequel we are interesting by asymptotic developments of the Legendre-Fenchel 





transform [58] (f+e* gi + ekg + ...e’gn)*(y) where y is a fixed point of the topological dual 
1 2 n 














X* of a locally convex space X and f: X— R| {+00} is a convex proper lower semicon- 











tinuous function, g : X— R, k= 1,2,...n are convex continuous functions. Assume that 





e€ + 0, > 0 and cig —+ 0 if k> +00 Vi = 1...n. For simplicity, take ef = ét and € > 0. 
If n=1 we have (f+eg1)*(y) = sup,ex{(t, y) — (f + eg)(x)}. Set ay = —(f+em)*(y) = 
infrex{ f(x) — (x,y) + egi(x)} and assume that there exists a class of hypotheses such 
that S, = arg minx(f(.) — (.,y)) is nonempty and a; = minzex{ f(x) — (x,y) + eg (x)} = 
minzex (f(x) — (x, y))+ eminses, 91(x) + €Y1(y, €) where y1(y, €) — 0 if e — 0. But zes, if 
and only if f(z)-(z,y) < infrexf(x)-(x, y) = —f*(y) or equivalently, f(z)+f*(y) < (z,y), Le 
zE Of*(y) the subdifferential in the sense of convex analysis of f* at y [58]. It turns out that 
(f+eg1)*(y) = f* (y) + elgi + dasa) (0)+ epi (y, c) where dap-(y(z) = 0 if ze Of (y) and 
das (y(z) = +00 otherwise. By [58, Th.6.5.8] , one has (g1 + dar«(y))*(0) = (91 VOS) (0) = 
gilt) + fdp (t) for some te X* where the operation Y stands for the infimal convo- 
lution, called also epi-sum in the literature (for the importance of this operation in opti- 
mization, see for instance |5, 58,76] and references therein). Furthermore if f*is finite and 
T(X*, X) continuous at y then 5p (w) = max-cas*(y)(W, r) = (f*) (y, w) Vw [58, Th.6.4.8]. 
Here (f*)'(y,w) = limy_,0+ SS is the directional derivative and 7(X*, X) is the 
Mackey topology on X*. So (f+eg:)*(y) = f(y)+e(gf V(F") (u,.))(0) + epi (y, €) = f*(u) + 
elg (t+ (f*) (y, -t)) + ep, (y, €). For n=2, assume that under suitable hypotheses we have 
minzex (f(x) — (x,y) + €g1(x) + €?go(x)) = minzex(f(x) — (a, y)) + €MiNgesy=y «5 JE) + 
e*infrex go(x)+ €%o(y, €), poly, €) — 0 when e — 0. Hence, (f+egi+e2g)* (y) = f*(y)+e(gi + 
Sass (u) )* (0) + 95 (0) + epaly, e)=f (y)+e(gi VF) (y, -))(0) + 295 (0)+ epa(y, €) if fis finite 
and 7(X*, X) continuous at y. For n=3 assume that there exist some assumptions under 





which one has the following equalities: -(f+eg, + €7g2 + €293)*(y) = minsex (f(x) — (x, y) + 
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£) + €?(go(x) + egs(x))) = minsex (f(x) — (x, y)) +eminse,…, gift) + minsex(ga(x) + 

æ)) + €k(y, €) 

minsex (f(x) — (x, y))+e REC ay o g1(r) + (minx g2) + minseags(0) 93(%) + yle) + 
y,€); then we compute (f+eg; + go + gs)" (y) =f" (y) + elgi + Sasa) )* (0) + €293(0) + 
so. + dags(o))*(0) + eps(y, €) with w3(y,e) — 0 when e — 0. If ftand g are respectively 

7(X*, X) continuous at y and 0 then (f+egi + e292 + 93)" (y) =f (y) + (gi V(F*) (y,.))(0) + 

egz (0) + (g#V(g5) (0, -))(0) + ep3(y, €). A straightforward generalization shows that under 





suitable hypotheses we have: 








(f +eg + go +.. + eg)" (y) =f (y) + €(g1 + for) (0) + €293 (0) + (93 + Fa930))*(0) + 
e gi (0) +e? (g5t+dags0))*(0)+...€7°93;(0) + TT (gair1+4ags,(0))*(0)+-.-€Pn(Y, €) 

(4.1) =f* (y) + (gi V(F") (y, -))(0) + 295 (0) + (93 V (g3) (0,.))(0) + €” g3; (0) + 
195, V (956) (0, -))(0) + ep, (y, €) with lim. oy, (y,6)= 0. 





THEOREM 4.4. Let X be a locally convex space and X* its topological dual. Let 
f:X— RU {+co}be a convex proper lower semicontinuous function and g;:X— R is convex 


























continuous Vi. If f(.)-(., y), (gai)is1 are weakly inf-compact and (g9;+1);>0 are bounded below 
for every i, j satisfying 2i, 2j+1< n then (4.1) holds. 

Proof. Let m; € R such that g;(x) > m; for every i and xeX. We have F.(x) =f(x)- 
(x, yt €gi(x) Sf(x)-(x2, yt em > f(x) — (x,y) —1 for every € < é, so Fe is 
weakly inf-compact and reaches its minimum at a point ze. Let acDomf; we have f(x,)- 
(re y) +5 m; <f(a)-(a, y+, egla) and E(xe)-(2e y) <Ea)-la, y) +E (gla) -m:) < 
f(a) — (a, y) + 1 for every e sufficiently small. Then (xe)e is weakly relatively compact, and 














by theorem 2.2 one has minx F4 =minse x (f(x)-(x, y)) +e minges, 81(x)+infrex X; € gi(æ) + 
eple). Now by the same argument inf,cx X; égi(x) = infsex(ga(x)+ega(x)+..e 29, (x)) = 
e minzex(92(2) + €ga(t) + -€"-2gn(at)) = € mittgex go(st) + 6 Minscargmin(ss x) 93(2) 

+ ée*{infrex Due 49:(x)} + vie), and step by step we derive formula (4.1) by 

[58, Th.6.4.8 , Th.6.5.8] and by the fact that the weak inf -compactness of f(.)-(., y) and go; 
implies that f* and g3,; are respectively T(X*, X) continuous at y and 0 [58,Th.6.3.9 and its 

















Corollary]. 
COROLLARY 4.5. Let X be a reflexive Banach space and X* its topological dual. Let 
f X— RU {+co} be a convex proper lower semicontinuous function and g;(x) = ||x||' for 














x —continuous at y then (4.1) holds with g5,(0) = 0 for every i> 1 
such that 2i<n . 

Proof. It is clear that g; i=1,2...n satisfy all hypotheses in theorem 4.4 and the Mackey 
topology T(X*, X) on X* is exactly the norme |||| x. topology, so the ||||xy« — continuity of f* 











at y is equivalent [58] to the weak inf-compactness of f(.)- (., y). 





5. NEW GENERALIZED REGULARIZATIONS FOR SADDLE FUNCTIONS 
AND ASYMPTOTIC DEVELOPMENTS 
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In what follows we are concerned by new generalized regularizations of saddle functions 
and their associated asymptotic developments. Consider two general topological Hausdorff 
spaces X,Y and ÉXXV— R, g:XxY— R, h:XxY— R be three functions with € > 0. 
Each function f, g is assumed to be lower semicontinuous (Isc) at the first variable and up- 






































per semicontinuous (usc) at the second variable. Denote by h} = supyey infrex he(2, y) 
and h? = infzex supycy h<(x,y) which are supposed finite for every € > 0 sufficiently 
small. Assume that the set S={(a,b)—eXxY/(a,b) is a saddle point of f } is nonempty. 
Set F.(z,y) = f(x,y) + ag(x,y) +h.(x,y) witha, >0,a — 0ife — 0. If he = 0 and 
g(x,y)= a; llel? —b; ||y||? with a;, b; are positive real numbers and p,qe N* then F. reduces 
to the classical Tikhonov regularization. 

Using a similar technique considered in the proof of theorem 2.2 with more difficult and 
sophisticated arguments we can state the following result: 

THEOREM. 5.1. Let (x.,y.). be a relatively compact sequence such that a, =sup,F.(xe,y), 
Be =inf, F-(x,y-), 7-(t)= sup,h.(t,y), 6-(z) =infxhe(x,z) are finite for every e sufficiently small 
and every (t,z)EXxY. Assume that the following condition holds: 

(5.1) lim,_9 =lim. p40 = 0 Vit,z) eX xY 

Then: 

(i) any cluster point (z, Y) of (x.,ye)e is a saddle point of f on XXY and is a saddle point 














of g on S. Furthermore for every a € R, there exists a sequence (6°, 02°, 02°) —> Ops if 


ETTE 





€ — 0 depending on the scheme under consideration such that F.(x.,y.)=f(%, Y) +aeg(T, Y) + 
2 1 
ah? + (1 — a)h? + acô? and the sequence (g(x4,7), g(T, Ye), JGT IE) fEy)-fEH) hehe Je 


Qe de de 








converges to (g(%,¥),g(Z, y), 0,0,0) if € > 0; 

(ii) Fi = f(z,y) + ag(%,y) + ah! + (1 — a)h? + a.6%% and lime 5024 
Fi = supycy infeex F(x, y) and F? = inf,ex supycy Fela, y). 

REMARK 5.2. The first limit in (5.1) is straightforward satisfied if (x.,y-) is a saddle 
point of F.. Also we observe that there exists a wide class of functions he :XxY — R sat- 


_ pl 
Fe — 0 where 
Qe 

















isfying the second limit in (5.1). Take for instance the functions of the kind h(x, y) = 


A bigi x,y) where m;(y) < gix, y) < Mix) V(x,y) EXxY. Here m;(y), M;(x) are 
i=1 “e 
sup,ey he(a;y)—infrex he(x,b) < 


E€XxY. In Particular one can 


real numbers and b > 0 satisfying lime 40% =0 Vi. Then 0< 
doer be. (Mi(a)—mi(b) Dinde (Mi(a)—mi(b)) _ Y(a, b) 


aE aE 





) and lim._o 








consider the classical functions used in many schemes of saddle point approximation meth- 














ods gx, y) = a; |£ — x;||"" — 8; lly — yil” where x;, y, are given points in the normed spaces 
X, Y , piq; € N* and a;, 8; > 0 (For instance, see [88,94] and references therein). More 
generally one may take h.(z,y) = D, b’ge(x,y) where there exist two real functions 


maly) and Max) such that for every (x,y) we have maly) < ga(x,y) < Ma(x) and 
lim, po iat Ce (Mei(a)=me; (8) = 0 V(a,b) EXXY then lime po = helay)-infsex he) _ O, For 


ac Qe 


example, see the regularization function considered in theorem 6.9. 
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COROLLARY 5.3. Let X, Y be two convex compacts of R” and R™ respectively. 
Assume that Fe: X x Y — R is finite, convex-concave and continuous with h.(x,y) = 
Xi bigiz, y) where gi : X x Y — R, i=1...p are such that m,(y) < gi(z,y) < Mix) 
V(x,y) EXXY. m;(y), M;(x) are real numbers and a, > 0,b’ > 0 satisfying limeso =0 


mingexmaxycy (f(x,y)tacg(z,y)+) F bégi(æ,y))-minse x maxycy (f(x,y) = 
ae 















































Vi, lim,_,oa = 0. Then lim. 
Mineamaxyeg(g(x,y)) where S = A x B. 

Proof. By [96], F. has a saddle point (xe,ye) and the sequence ((xe,ye))e is relatively 
compact. The limits in (5.1) are obviously satisfied, so the conclusions of theorem 5.1 hold. 
But for every (x,y)€ X x Y we have D 7 b muly)) <hl < h? < 37, bi M;(x)) then 


lim, 49% =lim, 49% = 0 which completes the proof. 





5.4. Conjugacy of Bivariate Functions and Asymptotic Developments 

Theorem 5.1 can provide an interesting tool for application to the conjugacy of bivariate 
functions as follows: Assume that X,Y are normed spaces with their topological dual X* and 
Y* respectively. Fix (x*, y*) in X*x Y* and set K(x*, y*) = sup, inf, ((v*, 2) +(y*, y)+9(2, y)) 
(for instance see [96] for the importance of this function in saddle functions theory and con- 
jugacy ), K.(x*,y*) = sup, inf. (f(x, y) + egi(, y) te gale y) + .--€"gn(a,y)), € > 0 where g, 
gi: XxY — R are given functions, i=1,2...n and f(x,y)=(a*,x) + (y*,y) + g(x,y). Denote 
by Sp and S 
nonempty. Under suitable hypotheses as in the previous theorem applied many times to f, 














gor respectively the sets of saddle points of f and ga, on XxY assumed to be 
gi and to the regularized scheme under consideration with he(x,y) = (gx, y) + €g3(a, y) + 
ega(x, y) + gsx, y) + "gx, y)) = H.(x, y), one can derive easily the following for- 
mula: If n=2p+1 then K,(x*,y*) =f(£0, yo) + €91 (£0, Yo) + © Go(@2, Yo) + €?g3 (a2, Y2) +... + 
EX gop (tk, Yar) + OH gong (Lor, Yor) + EP Jon (Lap, Yop) + EPT Japp (Xap; Yap) + eee ene fo 
some y converging to 0 if e — 0. If n=2p and a € R then K,(x*, y*) =f(x0, yo) +€g1 (£0, Yo) + 
€ go(x2, y2) +e? g3(X2, Yo) +... +E Gor (tar, Yor) + CT! Gonts (Loe, You) ++ 2 Gop—2(Lop—2, Yop—2) + 
CP Gon 1 (Lap—2; Yop-2) +EP (agza + (1 — 2) 95,) +52 ert with ri — 0 if e — 0. Here (zo, yo) 

is a saddle point of f on XxY and is also a saddle point of gı on Sy. (Lax, Yor) € S 


= 

















gx and is 


a saddle point of g2k+1 On Sox: 


6. WELL-POSEDNESS OF GENERALIZED REGULARIZATIONS FOR 
BIVARIATE FUNCTIONS 


In the sequel we investigate well-posedness of generalized regularizations of saddle func- 
tions. Let X,Y be two reflexive Banach spaces renormed by strictly convex norms ||.| +, Illy 
making them E-spaces [3, 34] and f:Xx Y—> R, g:XxY —R,h:XxY — R be three functions 
weakly Isc at the first variable for each fixed y and weakly usc at the second variable for 






































each fixed x. Consider F(x,y) = f(x,y) + eg(x, y) +h-(x,y) and assume that the follow- 
ing hypotheses are satisfied for a function F:XxY— R, (Hı) : Yx €X, Jy € Y such that 
F(x,y)>-00, and (H2) : Vy EY, Jx € X such that F(x,y) <+oo. Set g(x)= supyeyF (x,y), 
h(y)= infsexF(x,y). It is clear that Vx EX g(x)>-00, Vy €Y h(y)<+oo and the function 
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w(x,y)=g(x)-h(y) is well defined on Xx Y with w> 0. If (7, y) is a saddle point of F on XXY, 
then max,min,F(x,y)=min,F(x,y)=max,F(Z,y)= min,max,F(x,y) =g(%) =h(y) =F (7,7) 








is finite. 

DEFINITION 6.1 [26]. A sequence (£n, Yn)n in XX Y is called minimaximizing sequence 
of F if w(Xn,;¥n) — 0 when n> +00. 

The last definition is equivalent to the existence of en > 0,€, — 0 such that F(x,,y) < 
En t+F (x, Yn) V(x, y) EXXY. Note that a function does not always possess a minimaximizing 
sequence [26] . 

THEOREM 6.2 |26] . The following are equivalent: (a) F has a minimaximizing sequence 
on XxY; (b) inf, sup, F(x,y)=supy inf, F(x,y);(c) inf(x,y) W(x,y)=0. 

DEFINITION 6.3 [26]. We say that F has well- posed saddle problem on XXY or 
briefly (F, Xx Y) is well- posed if F has a unique saddle point Z = (T,y) on XxY and every 
minimaximizing sequence of F converges to Z in the norm topology. 

REMARK 6.4. For a stronger notion of well- posedness of saddle functions see for 
instance [75]. 

In what follows we state sufficient conditions ensuring that (F., Xx Y) is well- posed. 

THEOREM 6.5. Assume that f(x,y) sasisfies (H1) and (H2) and the following hypotheses 
are verified: (i) F.(.,y) is strictly convex and Isc Vy €Y; (ii) F(a, .) is strictly concave and 
usc Vx EX; (iii) Jyo € Y such that for every À € R, Ay = {x€ X/F (x, yo) < À} is bounded; 
(iv) 4 a EX such that for every À € R, By = {y€ Y/F(x0,y) > A} is bounded; v) 
A(a,b)€XxY such that f(a,b) is finite. Then: (a) inf, sup,F.(x,y)=supy, inf,F.(x,y); (b) Fe 
has a unique saddle point (£e, Y.) and F.(%., Ye) is finite; (c) every minimaximizing sequence 



































(Xn, Yn)n Of Fe converges weakly to (ze, Y.) if n— +œ and F:(£n, Ye), FT, Yn) Fe(Ln; Yn) 
converge to F.(Te, Ye) when n— +00. Moreover if there exist two functions p, qE {f,g, he} 
(eventually identical) such that p(xn, Ye) > p(Te Ye) and x, — Te (— denotes the weak 
convergence) imply that lim, ||v, — %.|| = 0 ; and q(%, Yn) > q(Te, J) and y, — J, imply 
that lim, ||yn — ¥,|| = 0; then (F, X xY) is well- posed. 

Proof. (a). By (i), (iii), (v) and [8] one has inf, sup,F.(x,y)=sup, inf.F.(x,y). (b). Set 
y.(x)=sup,F (x,y) which is convex Isc and w.(x)> F.(x, yo), so {xE X /p.(x)< A} is bounded 
for every À by (iii) and min,y,(x)=y,(%,) [58] for some Te. Using (ii),(iv) and [58], a sym- 
metric argument shows that max,w,(y) = 4.(y.) for some Y, where w,(y) =inf,F.(x,y); then 
by (a) 9.(%)=V-(Y.) ie sup, F.(%.,y)=inf,F.(x,9.)=F.(%,9.) which is finite because f(x,y) 
sasisfies (Hı) and (H2); consequently (T.,7.) is a saddle point of Fe on XxY. The unique- 
ness is immediate from strict convexity of F.(.,y) Vy and strict concavity of F.(x,.)Vz. 
(c). First we observe by Theorem 6.2 and (a) that the set of minimaximizing sequences 
of Fe is nonempty. Now let (Xn, Yn)n be a minimaximizing sequence of Fe. We have 
FelZ Ye) <Fe(@n, Ye) <Fe(L0, Yn) + En, €n > 0,€n — 0 and (yn)nis bounded by (iv). In the 
same way F.(2n, Yo) <Fe(®e, Yn) + En FT, Ye) + € and (Xn)nis bounded by (iii). By weak 
relative compactness of (Xn, Yn)n, Semicontinuity and uniqueness of the saddle point (Te, Ye), 
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it is a routine to check that x, — T. and y, — Y.. On the other hand, there exist three scalars 
m, M, a such that m<F. (rn, Ye) < Fe(X0, Yn) +t€n <M and MSF: (£n, Ye) <Fe (Fe, yn) +€n < À 
for every n, so Fe(£n, Je) , Fe(Ze, Yn) are bounded ; and by a classical argument they have 

a unique cluster point F.(%., Y.) to which they converge. But F.(2n, Ye) — En <Fe(@n, Yn) < 
F.(%e, Yn) +n, then F.(Ln, Yn) OF (Xe, Ye) when n—+00. Since F.(xn,9,) OF .(€,9. )=minzF.(x, 
Ye), Felle yn) OF e(e, Y¥-J=mMaxyF.(Z, y), (Xn)n and (Yn)n are respectively minimizing and 
maximizing sequences for the two last extremum problems; and as in the proof of Th.4.2 we 
show that the sequence ( f (£n, Ye), gln, Ye), heln, Ye))n converges to 





(f (Te Ye), glTe, Ye), he(Te,7.)). A symmetric argument shows that 


(f(Ze, Yn), 8Te, Yn) he(Te, Yn)) > (f (Te, Ye), G(Ley Ye), Rele, Ye)) when n — +00; s0 (xn,Yn)n 
converges in the norm topology to (ze, Y.) by hypothesis which completes the proof of the 














theorem. 





As an immediate consequence of the previous theorem and the fact that (X, ||.|,), (Y, 
||-||y) are E-spaces, we have the following corollaries: 

COROLLARY 6.6. Assume that f:X x Y— R is convex-concave lsc at the first variable 
for each fixed y and usc at the second variable for each fixed x and there exist (xo,Yo) in 
XxY and scalars m, M such that f(x,yo) >m, f(xo,y)<M for every (x,y)EXxY. Set F.(x,y)= 
(yee lea) a wW(\ly — y;|[") where € is a positive parameter, p,q,pi,q; 
€ N* and x;,y;, i=l,...p, j=1,...q are given points in X and Y respectively, yt, y’ : [0, +oo[ > 






































R are continuous functions at 0, convex and strictly increasing such that for every À € R the 
sets {x€ X/DP_, g(a — zll”) < A}, {ve ¥/D, Willly — vill”) < À} are bounded, then 
(Fe, XY) is well- posed. 

COROLLARY 6.7. Assume that f:XxY — R is convex-concave Isc at the first 
variable for each fixed y and usc at the second variable for each fixed x. Set F.(x,y)= 
f(xy) i % lle — mil 
i=1,...p, j=1,...q are given points in X and Y respectively. If there exist (xg,yo) in Xx Y and 
scalars m, M such that f(x,yo) >m, f(xo,y) <M for every (x,y)EXxY, then (Fe, XxY) is 
well- posed. 

COROLLARY 6.8. Assume that f:X x Y — R is convex-concave lsc at the first variable 
for each fixed y and usc at the second variable for each fixed x. Set 
F.(x,y)= f(x,y)+> i |, aces (le zilli ci) +0: — De 1 0jeezllu-usll +d;) +8; where €, a; 0; € RY, 
cdj, wi, ô; € R, p,q,piq; € N* and x;,y;, i=1,...p, J=1,...q are given points in X and Y 









































a 17e bi |y — y; where €, a}, bi € Ri, P;d;Pi,d; € N° and Xi, ;j; 






































respectively. If there exist (xo,yo) in Xx Y and scalars m, M such that f(x,yo) >m, f(xo,y) <M 
for every (x,y)EXxY, then (Fe, Xx Y) is well- posed. 

Finally we end our investigation by the following theorem in finite dimensional setting 
which combines the results of theorem 5.1 and the ones of theorem 6.5: 

THEOREM 6.9. Let R” x R” > R, fR” — R, gR” — R,i=1...p, j=1...q be real- 
valued functions such that f is continuous convex-concave and f;,g; are convex. Assume 
that the sets X={xe R™/fi(x) < 0, i = 1...p}, Y={ye R"/g;(y) < 0, j = 1,...q} are 
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nonempty and bounded. Set F.(x,y) = f(x, y) + ae(X r1 Ok [xxx — SOF, Be Ily-ve ll) + 
TP, einer HD+) _ 

te bit ee FU 
ae — 0 if e + 0 , hi, kj are convex continuous functions defined on X,Y respectively such 
that for every (x,y)E X xY, hi(x) < wi, k;(y) < ô; and lim, 40 Sain Esa = 0. 
T,8,p,q,Dk,qk € N* and xx, yx are given points in R” and R” respectively. If z = (ziji € 


) ae 
where a, Qk, Bks ie, Vie, Vie, tje are real positive numbers such that 









































RY, w € {m,n} we denote ||z|| = (5, 22)5 the strictly convex norm of R”. Then we have 














the following results: 

1) (Fe, X x Y) is well-posed; 

2) The conclusions of theorem 5.1 hold. 

For its proof we need the following lemma: 

LEMMA 6.10 [96, Corollary 37.6.2, p.397]. Let C and D be nonempty closed bounded 
convex sets in R” and R” respectively, and K be a continuous finite convex-concave function 
on CxD. Then K has a saddle point with respect to CxD. 

Proof of theorem 6.9. 1).The proof of this point is an immediate consequence of lemma 


























6.10 (applied to K=F, and Cx D=XxY) and various arguments used in the proof of theorem 
6.5 and the fact that the norm ||z|| = (37°, z2)2 is strictly convex, X, Y are convex compact 
sets and the weak convergence reduces to the norm convergence in finite dimensional setting. 

2). If (x.,y-) is the unique saddle point of F. on Xx Y, the sequence (x,,y.). is relatively 
compact and the first limit in (5.1) is straightforward satisfied. On the other hand it is easy 
to see that 


=> 5 =1 Oe jee” < h(x, y) < Diili ie! 


for every (x,y)EXxY, so 


; | 5; 
Q< Per he(x,y)—infrex he(x,y) < Dizi Mienie i+) j= bjetjee 3 
= Qe = de 


which goes to 0 if e + 0 and the second limit in (5.1) is also satisfied which completes 




















the proof. 


7. STABILITY OF VARIATIONAL ASYMPTOTIC DEVELOPMENTS OF 
BIVARIATE FUNCTIONS BY EPI/HYPO-CONVERGENCE 


Let us consider two Hausdorff tpological spaces (X, 7) and (Y, c) and a sequence F,:XXY — 











R of bivariate functions. First recall [4, 6, 7, 9] that the hypo/epi-limit inferior of the sequence 








lim, (inf,ey sup,cy F,(u, v))]. The epi/hypo-limit superior of (F,), denoted by e,/h, — ls Fn 
is defined by (e,/h; — IsF,)(@,y) =supuen,(xinfven(y) im, (sup,ey infueu F,,(u, v))]. 


Here N;,(x) is the class of all T—neighbourhoods of x. A bivariate function F: XxY — R 
is said to be an epi/hypo-limit of (Fn)n if er/ho — lsFn < F <h,/e, — liF, and we write 














(Fn)n denoted by h,/e,;—liF, is the function defined by (h,/e;—liF,)(x,y) =infven, (y) SUPUEN; (x) 
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F=e,/h,—limF,. The limit F in this sense is not in general unique and this convergence 
is in some sense minimal to obtain convergence of saddle points and saddle values (see for 
instance [9] and references therein). For other type of convergences and their importance in 
saddle point theory see for instance [6, 7, 24,25, 31,44]. When (X, 7) and (Y, a) are metriz- 
able, it is possible to give an easy representation of epi/hypo-limits in sequential terms [6, 9] 
that turns out to be very useful in practice. In this case F=e,/h,—limF,, if and only if 
V(a,y) E X x Y: (i) Vy, Oy, I £n — x such that lim, F(t, Yn) < F(x,y); Gi) Vas > z, 
Wn — y such that F(x,y)< lim, F,,(<n, yn). The sequence (F,), is said to epi/hypo-converge 
in the extended sense to F [6,9] if cl, (e;/ho —IsFn) < F < cl” (h,/e, —liF,,) where cl, and 
cl” are respectively the extended lower closure with respect to x for fixed y and the extended 








upper closure with respect to y for fixed x [9]. 
This section concerns the stability properties of the asymptotic developments 
(7.1) PE) Er) + akgn(Tn, Yn) + ah} +(1- a)hf + AKO n 
where (fn)n and (hy), are two sequences of bivariate functions epi/hypo-converging in the 
extended sense to f and h respectively and (£n, Yn) is a saddle point of f,. Here Fi (x,y) = 
fa(£, y) +akgnl£, y) + hklx, y) V(x, y) € X xY with a, > 0, ap — 0 and gn, hy: X xY >R 
are given functions. Our goal is to study the limit of F?(x?,y#) when k,n — +oo. To this 














end we state the following result: 
LEMMA 7.1 [71]. Assume that the functions F,:XxY— R epi/hypo-converge in the 
extended sense to a function F: Xx Y— R and there exist a sequence (£n, Yn)n of points in 


























XxY and a subsequence (n;)4 such that F,, (xx, y) < €e+Fn, (x, Yk) Yx, y where ex > 0 and 
€k — 0 when k— +00 . If the sequence (£n, Yn)n is relatively compact, there exist cluster 
points T, Y of (2n)n,(Yn)n respectively such that (T, y) is a saddle point of: 

(i) dF (x,y) and Fp, (re, Yk) > cleF(%,Y) when k> +00 if cl, F(x,y) is usc at y for each 
fixed x; 

(ii) cl’F(x,y) and Fp, (£k, Yk) > el’ F(Z, y) when k> +00 if cl” F(x,y) is lsc at x for each 
fixed y; 

(iii) F if F(x,y) is lsc at x for each fixed y and usc at y for each fixed x with Fn, (xx, Yk) > 
F(z, y) if k> +00; 

(iv) if (£n, Yn)n converges to a point (x’,y’), any epi/hypo-limit G of (F,), in the ex- 
tended sense, regardless of its semicontinuity, has (x’,y’) as a saddle point and F,, (xx, Yk) — 
G(x’, y’). 


REMARK 7.2. If (£n,Yn)n converges, the above lemma generalizes theorem 2.6 in 
[9, p.93] where the author supposes that (X, 7) and (Y, o) are metrizable spaces and eg = 0. 
It 

should be pointed out that the proof of our lemma is very different from the one presented 
in the last reference. If sup,F,, (xx, y), infsFn,(X,yx) are finite for every k>ko, hypothesis 
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Far, Y) < &+Fn, (£, Yk) Ve, y is equivalent to sup,Fn, (tr, y) —infsFn,(x,yx) — 0 when 
k— +oo. 

THEOREM 7.3. Let ( fn)n: XXY—> R, (hy)g: XXY— R be two sequences of functions 
epi/hypo-converging in the extended sense respectively to f and h which are assumed to 


























be lower semicontinuous at x, upper semicontinuous at y. Assume that the variational 
asymptotic development (7.1) holds with (x},y}) and (£n, Yn) are saddle points of Fẹ and fn 
respectively and (£n, Yn)n is supposed to be relatively compact. Suppose furthermore that 
supycy helt, y) — infrex hilz, z) — 0 if k > +00, V(t,z) € Sp, = {(a,b)EXxY/(a,b) is a 
saddle point of fn}, Yn. Then there exists a subsequence (ng) such that 

lim, Fr*(x;",y;")=f(@, y)+h(Z, t) where (x,y) and (Z,t) are two saddle points of f and h 
respectively. 

Proof. First, fix an integer ne N and set sup ey he (@n, y) — infrex hx(t, Yn) = wY.Then 
he(Xn, Y)S wt + he(x, Yn) for all (x,y)EXxY and hy <h? < hAg(@n, Yn) + wh < 2wP+h}; 
so by lemma 7.1, limh} =limgh? = h(a, Yn) and (£n, Yn) is a saddle point of h; conse- 
quently lim, F? (x? yk )=fn (£n, Yn) HA(Ln,; Yn), again by this lemma (£n, y,), has cluster points 
(z,9),(Z, t) which are saddle points of f and h respectively such that f,(x,,yr) > f(T,7) and 











h(n, Yn) > h(Z,t) when n> +00. Diagonalization lemma [3] permits then to conclude. 
REMARK 7.4. In (7.1) and theorem 7.3 we don’t need any information neither on 
the behavior of the sequence (g,,), nor on its mode of convergence. 
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